Pandas Profiling Report

Dataset statistics

Number of variables	15
Number of observations	23040
Missing cells	17
Missing cells (%)	< 0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	2.6 MiB
Average record size in memory	120.0 B

Variable types

Numeric	9
Categorical	6

Warnings

`tran_date` has a high cardinality: 1129 distinct values	High cardinality
`dob` has a high cardinality: 3987 distinct values	High cardinality
`Unnamed: 0` is uniformly distributed	Uniform
`Unnamed: 0` has unique values	Unique

Reproduction

Analysis started	2021-02-02 16:49:07.970614
Analysis finished	2021-02-02 16:49:21.175337
Duration	13.2 seconds
Software version	pandas-profiling v2.10.0
Download configuration	config.yaml

transaction_id
Real number (ℝ_≥0)

Distinct	20878
Distinct (%)	90.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	5.006955222 × 10¹⁰
Minimum	3268991
Maximum	9.998754963 × 10¹⁰
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	3268991
5-th percentile	5090661728
Q1	2.493314715 × 10¹⁰
median	5.009188013 × 10¹⁰
Q3	7.532631777 × 10¹⁰
95-th percentile	9.508100653 × 10¹⁰
Maximum	9.998754963 × 10¹⁰
Range	9.998428064 × 10¹⁰
Interquartile range (IQR)	5.039317062 × 10¹⁰

Descriptive statistics

Standard deviation	2.898061538 × 10¹⁰
Coefficient of variation (CV)	0.5788071612
Kurtosis	-1.209031909
Mean	5.006955222 × 10¹⁰
Median Absolute Deviation (MAD)	2.520770895 × 10¹⁰
Skewness	0.001602727141
Sum	1.153602483 × 10¹⁵
Variance	8.398760679 × 10²⁰
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3.226393808 × 10¹⁰	4	< 0.1%
3130889793	3	< 0.1%
5.065162125 × 10¹⁰	3	< 0.1%
1.135553904 × 10¹⁰	3	< 0.1%
3.204326498 × 10¹⁰	3	< 0.1%
1.46940352 × 10¹⁰	3	< 0.1%
4.150935019 × 10¹⁰	3	< 0.1%
5.870764126 × 10¹⁰	3	< 0.1%
5.580834711 × 10¹⁰	3	< 0.1%
6.29193547 × 10¹⁰	3	< 0.1%
Other values (20868)	23009	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
3268991	1	< 0.1%
7073244	1	< 0.1%
10861359	1	< 0.1%
15741026	1	< 0.1%
16165359	1	< 0.1%

Value	Count	Frequency (%)
9.998754963 × 10¹⁰	1	< 0.1%
9.998675162 × 10¹⁰	2	< 0.1%
9.998512147 × 10¹⁰	1	< 0.1%
9.996777519 × 10¹⁰	1	< 0.1%
9.996351651 × 10¹⁰	2	< 0.1%

Unnamed: 0
Real number (ℝ_≥0)

UNIFORM
UNIQUE

Distinct	23040
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	11525.45412
Minimum	0
Maximum	23052
Zeros	1
Zeros (%)	< 0.1%
Memory size	180.1 KiB

Quantile statistics

Minimum	0
5-th percentile	1151.95
Q1	5761.75
median	11525.5
Q3	17290.25
95-th percentile	21900.05
Maximum	23052
Range	23052
Interquartile range (IQR)	11528.5

Descriptive statistics

Standard deviation	6655.799472
Coefficient of variation (CV)	0.5774869606
Kurtosis	-1.200281
Mean	11525.45412
Median Absolute Deviation (MAD)	5764.5
Skewness	0.0001726856606
Sum	265546463
Variance	44299666.61
Monotocity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2047	1	< 0.1%
2692	1	< 0.1%
6790	1	< 0.1%
4743	1	< 0.1%
19084	1	< 0.1%
17037	1	< 0.1%
21135	1	< 0.1%
10896	1	< 0.1%
8849	1	< 0.1%
14994	1	< 0.1%
Other values (23030)	23030	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%

Value	Count	Frequency (%)
23052	1	< 0.1%
23051	1	< 0.1%
23050	1	< 0.1%
23049	1	< 0.1%
23048	1	< 0.1%

cust_id
Real number (ℝ_≥0)

Distinct	5506
Distinct (%)	23.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	271021.8803
Minimum	266783
Maximum	275265
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	266783
5-th percentile	267241
Q1	268935
median	270980.5
Q3	273114.25
95-th percentile	274839
Maximum	275265
Range	8482
Interquartile range (IQR)	4179.25

Descriptive statistics

Standard deviation	2431.573668
Coefficient of variation (CV)	0.008971872183
Kurtosis	-1.183937792
Mean	271021.8803
Median Absolute Deviation (MAD)	2082.5
Skewness	0.01860150125
Sum	6244344121
Variance	5912550.505
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
268819	13	0.1%
269449	13	0.1%
266794	12	0.1%
273014	12	0.1%
269245	12	0.1%
272415	12	0.1%
275252	12	0.1%
270831	12	0.1%
274227	12	0.1%
272286	12	0.1%
Other values (5496)	22918	99.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
266783	5	< 0.1%
266784	3	< 0.1%
266785	8	< 0.1%
266788	4	< 0.1%
266794	12	0.1%

Value	Count	Frequency (%)
275265	3	< 0.1%
275264	2	< 0.1%
275262	2	< 0.1%
275261	5	< 0.1%
275257	5	< 0.1%

tran_date
Categorical

HIGH CARDINALITY

Distinct	1129
Distinct (%)	4.9%
Missing	0
Missing (%)	0.0%
Memory size	180.1 KiB

2011-07-13	35
2013-12-21	33
2011-09-25	33
2011-10-23	33
2011-11-22	33
Other values (1124)	22873

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	230400
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	3 ?
Unique (%)	< 0.1%

Sample

1st row	2014-02-28
2nd row	2014-02-27
3rd row	2014-02-24
4th row	2014-02-24
5th row	2014-02-23

Value	Count	Frequency (%)
2011-07-13	35	0.2%
2013-12-21	33	0.1%
2011-09-25	33	0.1%
2011-10-23	33	0.1%
2011-11-22	33	0.1%
2013-09-03	32	0.1%
2012-11-25	32	0.1%
2014-01-01	31	0.1%
2012-05-04	31	0.1%
2012-06-10	31	0.1%
Other values (1119)	22716	98.6%

Histogram of lengths of the category

Value	Count	Frequency (%)
2011-07-13	35	0.2%
2013-12-21	33	0.1%
2011-09-25	33	0.1%
2011-10-23	33	0.1%
2011-11-22	33	0.1%
2013-09-03	32	0.1%
2012-11-25	32	0.1%
2014-01-01	31	0.1%
2012-05-04	31	0.1%
2012-06-10	31	0.1%
Other values (1119)	22716	98.6%

Most occurring characters

Value	Count	Frequency (%)
0	51469	22.3%
1	49851	21.6%
-	46080	20.0%
2	44381	19.3%
3	12825	5.6%
4	5137	2.2%
8	4233	1.8%
9	4154	1.8%
7	4151	1.8%
5	4149	1.8%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	184320	80.0%
Dash Punctuation	46080	20.0%

Most frequent character per category

Value	Count	Frequency (%)
0	51469	27.9%
1	49851	27.0%
2	44381	24.1%
3	12825	7.0%
4	5137	2.8%
8	4233	2.3%
9	4154	2.3%
7	4151	2.3%
5	4149	2.3%
6	3970	2.2%

Value	Count	Frequency (%)
-	46080	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	230400	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	51469	22.3%
1	49851	21.6%
-	46080	20.0%
2	44381	19.3%
3	12825	5.6%
4	5137	2.2%
8	4233	1.8%
9	4154	1.8%
7	4151	1.8%
5	4149	1.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	230400	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	51469	22.3%
1	49851	21.6%
-	46080	20.0%
2	44381	19.3%
3	12825	5.6%
4	5137	2.2%
8	4233	1.8%
9	4154	1.8%
7	4151	1.8%
5	4149	1.8%

prod_subcat_code
Real number (ℝ_≥0)

Distinct	12
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	6.148784722
Minimum	1
Maximum	12
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	5
Q3	10
95-th percentile	12
Maximum	12
Range	11
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	3.726196737
Coefficient of variation (CV)	0.6060053987
Kurtosis	-1.421979537
Mean	6.148784722
Median Absolute Deviation (MAD)	3
Skewness	0.1931944433
Sum	141668
Variance	13.88454212
Monotocity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
4	4000	17.4%
3	3065	13.3%
10	2991	13.0%
1	2948	12.8%
11	2057	8.9%
12	2027	8.8%
7	1043	4.5%
2	1007	4.4%
6	989	4.3%
9	985	4.3%
Other values (2)	1928	8.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2948	12.8%
2	1007	4.4%
3	3065	13.3%
4	4000	17.4%
5	958	4.2%

Value	Count	Frequency (%)
12	2027	8.8%
11	2057	8.9%
10	2991	13.0%
9	985	4.3%
8	970	4.2%

prod_cat_code
Real number (ℝ_≥0)

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.763498264
Minimum	1
Maximum	6
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	5
95-th percentile	6
Maximum	6
Range	5
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.677091287
Coefficient of variation (CV)	0.4456203164
Kurtosis	-1.240404185
Mean	3.763498264
Median Absolute Deviation (MAD)	1
Skewness	-0.2155958816
Sum	86711
Variance	2.812635186
Monotocity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
5	6066	26.3%
3	4895	21.2%
6	4126	17.9%
2	2996	13.0%
1	2960	12.8%
4	1997	8.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2960	12.8%
2	2996	13.0%
3	4895	21.2%
4	1997	8.7%
5	6066	26.3%

Value	Count	Frequency (%)
6	4126	17.9%
5	6066	26.3%
4	1997	8.7%
3	4895	21.2%
2	2996	13.0%

quantity
Real number (ℝ)

Distinct	10
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.435763889
Minimum	-5
Maximum	5
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	-5
5-th percentile	-3
Q1	1
median	3
Q3	4
95-th percentile	5
Maximum	5
Range	10
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.264326091
Coefficient of variation (CV)	0.9296164135
Kurtosis	1.903364817
Mean	2.435763889
Median Absolute Deviation (MAD)	1
Skewness	-1.31429443
Sum	56120
Variance	5.127172644
Monotocity	Not monotonic

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
5	4259	18.5%
1	4214	18.3%
3	4174	18.1%
2	4123	17.9%
4	4106	17.8%
-4	455	2.0%
-5	452	2.0%
-2	436	1.9%
-1	417	1.8%
-3	404	1.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-5	452	2.0%
-4	455	2.0%
-3	404	1.8%
-2	436	1.9%
-1	417	1.8%

Value	Count	Frequency (%)
5	4259	18.5%
4	4106	17.8%
3	4174	18.1%
2	4123	17.9%
1	4214	18.3%

rate
Real number (ℝ)

Distinct	2551
Distinct (%)	11.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	637.0949653
Minimum	-1499
Maximum	1500
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	-1499
5-th percentile	-764
Q1	312
median	710
Q3	1109
95-th percentile	1423
Maximum	1500
Range	2999
Interquartile range (IQR)	797

Descriptive statistics

Standard deviation	621.7273737
Coefficient of variation (CV)	0.9758786485
Kurtosis	1.510645611
Mean	637.0949653
Median Absolute Deviation (MAD)	399
Skewness	-1.146009956
Sum	14678668
Variance	386544.9272
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
672	29	0.1%
552	29	0.1%
472	28	0.1%
615	27	0.1%
618	27	0.1%
922	27	0.1%
1043	26	0.1%
198	26	0.1%
881	25	0.1%
173	25	0.1%
Other values (2541)	22771	98.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-1499	2	< 0.1%
-1498	4	< 0.1%
-1497	2	< 0.1%
-1496	3	< 0.1%
-1494	3	< 0.1%

Value	Count	Frequency (%)
1500	16	0.1%
1499	13	0.1%
1498	17	0.1%
1497	8	< 0.1%
1496	20	0.1%

total_amt
Real number (ℝ)

Distinct	5764
Distinct (%)	25.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2109.865226
Minimum	-8270.925
Maximum	8287.5
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	-8270.925
5-th percentile	-1962.48
Q1	762.45
median	1756.95
Q3	3570.255
95-th percentile	6469.775
Maximum	8287.5
Range	16558.425
Interquartile range (IQR)	2807.805

Descriptive statistics

Standard deviation	2505.610295
Coefficient of variation (CV)	1.187568885
Kurtosis	1.501467648
Mean	2109.865226
Median Absolute Deviation (MAD)	1252.5175
Skewness	-0.3306547843
Sum	48611294.81
Variance	6278082.948
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
676.26	22	0.1%
729.3	22	0.1%
3049.8	22	0.1%
1021.02	21	0.1%
1359.15	21	0.1%
1591.2	21	0.1%
861.9	21	0.1%
397.8	21	0.1%
486.2	20	0.1%
1432.08	20	0.1%
Other values (5754)	22829	99.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-8270.925	1	< 0.1%
-8160.425	1	< 0.1%
-8154.9	1	< 0.1%
-8143.85	1	< 0.1%
-8138.325	1	< 0.1%

Value	Count	Frequency (%)
8287.5	4	< 0.1%
8281.975	5	< 0.1%
8276.45	3	< 0.1%
8270.925	3	< 0.1%
8265.4	9	< 0.1%

store_type
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	180.1 KiB

e-Shop	9304
MBR	4660
Flagship store	4575
TeleShop	4501

Length

Max length	14
Median length	6
Mean length	7.372482639
Min length	3

Characters and Unicode

Total characters	169862
Distinct characters	19
Distinct categories	4 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	e-Shop
2nd row	e-Shop
3rd row	TeleShop
4th row	e-Shop
5th row	TeleShop

Value	Count	Frequency (%)
e-Shop	9304	40.4%
MBR	4660	20.2%
Flagship store	4575	19.9%
TeleShop	4501	19.5%

Histogram of lengths of the category

Value	Count	Frequency (%)
e-shop	9304	33.7%
mbr	4660	16.9%
store	4575	16.6%
flagship	4575	16.6%
teleshop	4501	16.3%

Most occurring characters

Value	Count	Frequency (%)
e	22881	13.5%
h	18380	10.8%
o	18380	10.8%
p	18380	10.8%
S	13805	8.1%
-	9304	5.5%
s	9150	5.4%
l	9076	5.3%
M	4660	2.7%
B	4660	2.7%
Other values (9)	41186	24.2%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	119122	70.1%
Uppercase Letter	36861	21.7%
Dash Punctuation	9304	5.5%
Space Separator	4575	2.7%

Most frequent character per category

Value	Count	Frequency (%)
e	22881	19.2%
h	18380	15.4%
o	18380	15.4%
p	18380	15.4%
s	9150	7.7%
l	9076	7.6%
a	4575	3.8%
g	4575	3.8%
i	4575	3.8%
t	4575	3.8%

Value	Count	Frequency (%)
S	13805	37.5%
M	4660	12.6%
B	4660	12.6%
R	4660	12.6%
F	4575	12.4%
T	4501	12.2%

Value	Count	Frequency (%)
-	9304	100.0%

Value	Count	Frequency (%)
	4575	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	155983	91.8%
Common	13879	8.2%

Most frequent character per script

Value	Count	Frequency (%)
e	22881	14.7%
h	18380	11.8%
o	18380	11.8%
p	18380	11.8%
S	13805	8.9%
s	9150	5.9%
l	9076	5.8%
M	4660	3.0%
B	4660	3.0%
R	4660	3.0%
Other values (7)	31951	20.5%

Value	Count	Frequency (%)
-	9304	67.0%
	4575	33.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	169862	100.0%

Most frequent character per block

Value	Count	Frequency (%)
e	22881	13.5%
h	18380	10.8%
o	18380	10.8%
p	18380	10.8%
S	13805	8.1%
-	9304	5.5%
s	9150	5.4%
l	9076	5.3%
M	4660	2.7%
B	4660	2.7%
Other values (9)	41186	24.2%

prod_cat
Categorical

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	180.1 KiB

Books	6066
Electronics	4895
Home and kitchen	4126
Footwear	2996
Clothing	2960

Length

Max length	16
Median length	8
Mean length	8.933463542
Min length	4

Characters and Unicode

Total characters	205827
Distinct characters	22
Distinct categories	3 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Clothing
2nd row	Electronics
3rd row	Books
4th row	Home and kitchen
5th row	Books

Value	Count	Frequency (%)
Books	6066	26.3%
Electronics	4895	21.2%
Home and kitchen	4126	17.9%
Footwear	2996	13.0%
Clothing	2960	12.8%
Bags	1997	8.7%

Histogram of lengths of the category

Value	Count	Frequency (%)
books	6066	19.4%
electronics	4895	15.6%
home	4126	13.2%
and	4126	13.2%
kitchen	4126	13.2%
footwear	2996	9.6%
clothing	2960	9.5%
bags	1997	6.4%

Most occurring characters

Value	Count	Frequency (%)
o	30105	14.6%
e	16143	7.8%
n	16107	7.8%
t	14977	7.3%
c	13916	6.8%
s	12958	6.3%
i	11981	5.8%
k	10192	5.0%
a	9119	4.4%
	8252	4.0%
Other values (12)	62077	30.2%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	174535	84.8%
Uppercase Letter	23040	11.2%
Space Separator	8252	4.0%

Most frequent character per category

Value	Count	Frequency (%)
o	30105	17.2%
e	16143	9.2%
n	16107	9.2%
t	14977	8.6%
c	13916	8.0%
s	12958	7.4%
i	11981	6.9%
k	10192	5.8%
a	9119	5.2%
r	7891	4.5%
Other values (6)	31146	17.8%

Value	Count	Frequency (%)
B	8063	35.0%
E	4895	21.2%
H	4126	17.9%
F	2996	13.0%
C	2960	12.8%

Value	Count	Frequency (%)
	8252	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	197575	96.0%
Common	8252	4.0%

Most frequent character per script

Value	Count	Frequency (%)
o	30105	15.2%
e	16143	8.2%
n	16107	8.2%
t	14977	7.6%
c	13916	7.0%
s	12958	6.6%
i	11981	6.1%
k	10192	5.2%
a	9119	4.6%
B	8063	4.1%
Other values (11)	54014	27.3%

Value	Count	Frequency (%)
	8252	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	205827	100.0%

Most frequent character per block

Value	Count	Frequency (%)
o	30105	14.6%
e	16143	7.8%
n	16107	7.8%
t	14977	7.3%
c	13916	6.8%
s	12958	6.3%
i	11981	5.8%
k	10192	5.0%
a	9119	4.4%
	8252	4.0%
Other values (12)	62077	30.2%

prod_subcat
Categorical

Distinct	18
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	180.1 KiB

Women	3046
Mens	2910
Kids	1997
Tools	1061
Fiction	1043
Other values (13)	12983

Length

Max length	19
Median length	6
Mean length	6.966102431
Min length	3

Characters and Unicode

Total characters	160499
Distinct characters	33
Distinct categories	4 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Women
2nd row	Computers
3rd row	DIY
4th row	Bath
5th row	DIY

Value	Count	Frequency (%)
Women	3046	13.2%
Mens	2910	12.6%
Kids	1997	8.7%
Tools	1061	4.6%
Fiction	1043	4.5%
Kitchen	1036	4.5%
Children	1035	4.5%
Comics	1030	4.5%
Mobiles	1030	4.5%
Bath	1022	4.4%
Other values (8)	7830	34.0%

Histogram of lengths of the category

Value	Count	Frequency (%)
women	3046	11.8%
mens	2910	11.2%
kids	1997	7.7%
tools	1061	4.1%
fiction	1043	4.0%
kitchen	1036	4.0%
children	1035	4.0%
comics	1030	4.0%
mobiles	1030	4.0%
bath	1022	3.9%
Other values (11)	10704	41.3%

Most occurring characters

Value	Count	Frequency (%)
i	16074	10.0%
n	15982	10.0%
e	14858	9.3%
o	14109	8.8%
s	12918	8.0%
c	7014	4.4%
m	6985	4.4%
d	6854	4.3%
a	6850	4.3%
l	5066	3.2%
Other values (23)	53789	33.5%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	129631	80.8%
Uppercase Letter	26991	16.8%
Space Separator	2874	1.8%
Dash Punctuation	1003	0.6%

Most frequent character per category

Value	Count	Frequency (%)
i	16074	12.4%
n	15982	12.3%
e	14858	11.5%
o	14109	10.9%
s	12918	10.0%
c	7014	5.4%
m	6985	5.4%
d	6854	5.3%
a	6850	5.3%
l	5066	3.9%
Other values (8)	22921	17.7%

Value	Count	Frequency (%)
C	4008	14.8%
M	3940	14.6%
F	3053	11.3%
W	3046	11.3%
K	3033	11.2%
A	2888	10.7%
T	1061	3.9%
B	1022	3.8%
N	1003	3.7%
D	989	3.7%
Other values (3)	2948	10.9%

Value	Count	Frequency (%)
	2874	100.0%

Value	Count	Frequency (%)
-	1003	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	156622	97.6%
Common	3877	2.4%

Most frequent character per script

Value	Count	Frequency (%)
i	16074	10.3%
n	15982	10.2%
e	14858	9.5%
o	14109	9.0%
s	12918	8.2%
c	7014	4.5%
m	6985	4.5%
d	6854	4.4%
a	6850	4.4%
l	5066	3.2%
Other values (21)	49912	31.9%

Value	Count	Frequency (%)
	2874	74.1%
-	1003	25.9%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	160499	100.0%

Most frequent character per block

Value	Count	Frequency (%)
i	16074	10.0%
n	15982	10.0%
e	14858	9.3%
o	14109	8.8%
s	12918	8.0%
c	7014	4.4%
m	6985	4.4%
d	6854	4.3%
a	6850	4.3%
l	5066	3.2%
Other values (23)	53789	33.5%

dob
Categorical

HIGH CARDINALITY

Distinct	3987
Distinct (%)	17.3%
Missing	0
Missing (%)	0.0%
Memory size	180.1 KiB

1982-09-17	32
1988-12-27	32
1974-02-25	27
1972-03-20	25
1970-06-09	24
Other values (3982)	22900

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	230400
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	200 ?
Unique (%)	0.9%

Sample

1st row	1981-09-26
2nd row	1973-05-11
3rd row	1992-07-27
4th row	1981-06-08
5th row	1992-07-27

Value	Count	Frequency (%)
1982-09-17	32	0.1%
1988-12-27	32	0.1%
1974-02-25	27	0.1%
1972-03-20	25	0.1%
1970-06-09	24	0.1%
1991-11-18	24	0.1%
1977-05-26	23	0.1%
1983-03-08	22	0.1%
1981-12-20	22	0.1%
1988-07-21	22	0.1%
Other values (3977)	22787	98.9%

Histogram of lengths of the category

Value	Count	Frequency (%)
1982-09-17	32	0.1%
1988-12-27	32	0.1%
1974-02-25	27	0.1%
1972-03-20	25	0.1%
1970-06-09	24	0.1%
1991-11-18	24	0.1%
1977-05-26	23	0.1%
1983-03-08	22	0.1%
1981-12-20	22	0.1%
1988-07-21	22	0.1%
Other values (3977)	22787	98.9%

Most occurring characters

Value	Count	Frequency (%)
-	46080	20.0%
1	45615	19.8%
9	32481	14.1%
0	30634	13.3%
2	17615	7.6%
7	16602	7.2%
8	16286	7.1%
5	6512	2.8%
6	6258	2.7%
4	6226	2.7%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	184320	80.0%
Dash Punctuation	46080	20.0%

Most frequent character per category

Value	Count	Frequency (%)
1	45615	24.7%
9	32481	17.6%
0	30634	16.6%
2	17615	9.6%
7	16602	9.0%
8	16286	8.8%
5	6512	3.5%
6	6258	3.4%
4	6226	3.4%
3	6091	3.3%

Value	Count	Frequency (%)
-	46080	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	230400	100.0%

Most frequent character per script

Value	Count	Frequency (%)
-	46080	20.0%
1	45615	19.8%
9	32481	14.1%
0	30634	13.3%
2	17615	7.6%
7	16602	7.2%
8	16286	7.1%
5	6512	2.8%
6	6258	2.7%
4	6226	2.7%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	230400	100.0%

Most frequent character per block

Value	Count	Frequency (%)
-	46080	20.0%
1	45615	19.8%
9	32481	14.1%
0	30634	13.3%
2	17615	7.6%
7	16602	7.2%
8	16286	7.1%
5	6512	2.8%
6	6258	2.7%
4	6226	2.7%

gender
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	9
Missing (%)	< 0.1%
Memory size	180.1 KiB

M	11804
F	11227

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	23031
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	M
2nd row	F
3rd row	M
4th row	M
5th row	M

Value	Count	Frequency (%)
M	11804	51.2%
F	11227	48.7%
(Missing)	9	< 0.1%

Histogram of lengths of the category

Value	Count	Frequency (%)
m	11804	51.3%
f	11227	48.7%

Most occurring characters

Value	Count	Frequency (%)
M	11804	51.3%
F	11227	48.7%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	23031	100.0%

Most frequent character per category

Value	Count	Frequency (%)
M	11804	51.3%
F	11227	48.7%

Most occurring scripts

Value	Count	Frequency (%)
Latin	23031	100.0%

Most frequent character per script

Value	Count	Frequency (%)
M	11804	51.3%
F	11227	48.7%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	23031	100.0%

Most frequent character per block

Value	Count	Frequency (%)
M	11804	51.3%
F	11227	48.7%

city_code
Real number (ℝ_≥0)

Distinct	10
Distinct (%)	< 0.1%
Missing	8
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	5.483067037
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	180.1 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	5
Q3	8
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	2.863330666
Coefficient of variation (CV)	0.5222133246
Kurtosis	-1.218240634
Mean	5.483067037
Median Absolute Deviation (MAD)	2
Skewness	0.02075893494
Sum	126286
Variance	8.198662505
Monotocity	Not monotonic

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
4	2422	10.5%
3	2410	10.5%
5	2357	10.2%
7	2356	10.2%
10	2333	10.1%
8	2328	10.1%
2	2268	9.8%
1	2255	9.8%
9	2176	9.4%
6	2127	9.2%
(Missing)	8	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2255	9.8%
2	2268	9.8%
3	2410	10.5%
4	2422	10.5%
5	2357	10.2%

Value	Count	Frequency (%)
10	2333	10.1%
9	2176	9.4%
8	2328	10.1%
7	2356	10.2%
6	2127	9.2%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	transaction_id	Unnamed: 0	cust_id	tran_date	prod_subcat_code	prod_cat_code	quantity	rate	total_amt	store_type	prod_cat	prod_subcat	dob	gender	city_code
0	80712190438	0	270351	2014-02-28	1	1	-5	-772	-4265.300	e-Shop	Clothing	Women	1981-09-26	M	5.0
1	29258453508	1	270384	2014-02-27	5	3	-5	-1497	-8270.925	e-Shop	Electronics	Computers	1973-05-11	F	8.0
2	51750724947	2	273420	2014-02-24	6	5	-2	-791	-1748.110	TeleShop	Books	DIY	1992-07-27	M	8.0
3	93274880719	3	271509	2014-02-24	11	6	-3	-1363	-4518.345	e-Shop	Home and kitchen	Bath	1981-06-08	M	3.0
4	51750724947	4	273420	2014-02-23	6	5	-2	-791	-1748.110	TeleShop	Books	DIY	1992-07-27	M	8.0
5	97439039119	5	272357	2014-02-23	8	3	-2	-824	-1821.040	TeleShop	Electronics	Personal Appliances	1982-10-09	F	6.0
6	45649838090	6	273667	2014-02-22	11	6	-1	-1450	-1602.250	e-Shop	Home and kitchen	Bath	1981-05-29	M	9.0
7	22643667930	7	271489	2014-02-22	12	6	-1	-1225	-1353.625	TeleShop	Home and kitchen	Tools	1971-04-21	M	9.0
8	79792372943	8	275108	2014-02-22	3	1	-3	-908	-3010.020	MBR	Clothing	Kids	1971-11-04	F	8.0
9	50076728598	9	269014	2014-02-21	8	3	-4	-581	-2568.020	e-Shop	Electronics	Personal Appliances	1979-11-27	F	3.0

Last rows

	transaction_id	Unnamed: 0	cust_id	tran_date	prod_subcat_code	prod_cat_code	quantity	rate	total_amt	store_type	prod_cat	prod_subcat	dob	gender	city_code
23030	49882891062	23043	271982	2011-01-25	10	5	4	1330	5878.600	e-Shop	Books	Non-Fiction	1976-08-10	M	8.0
23031	14787475597	23044	273982	2011-01-25	4	3	5	969	5353.725	e-Shop	Electronics	Mobiles	1991-10-12	M	4.0
23032	50691119572	23045	273031	2011-01-25	6	5	1	1148	1268.540	TeleShop	Books	DIY	1980-01-17	F	8.0
23033	40893803228	23046	272049	2011-01-25	11	6	3	1077	3570.255	e-Shop	Home and kitchen	Bath	1975-06-28	F	6.0
23034	30856003613	23047	266866	2011-01-25	4	2	2	444	981.240	TeleShop	Footwear	Kids	1974-04-18	M	4.0
23035	94340757522	23048	274550	2011-01-25	12	5	1	1264	1396.720	e-Shop	Books	Academic	1972-02-21	M	7.0
23036	89780862956	23049	270022	2011-01-25	4	1	1	677	748.085	e-Shop	Clothing	Mens	1984-04-27	M	9.0
23037	85115299378	23050	271020	2011-01-25	2	6	4	1052	4649.840	MBR	Home and kitchen	Furnishing	1976-06-20	M	8.0
23038	72870271171	23051	270911	2011-01-25	11	5	3	1142	3785.730	TeleShop	Books	Children	1970-05-22	M	2.0
23039	77960931771	23052	271961	2011-01-25	11	5	1	447	493.935	TeleShop	Books	Children	1982-01-15	M	1.0

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows